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Abstract 

State space and hidden Markov models can both be subsumed under the 
same mathematical structure. On a suitable probability space (Q, A, P) are 
defined (Xi, Y\,X^, Yi, ■ ■ ■ , X n , Y n , . . . ) a sequence of random "variables" tak- 
ing values in a product space II (^j x 3^) with an appropriate sigma field. 
The joint behavior under P is that the Xj are stationary Markovian and that 
given (X 1 ,X2, . . . ) the Yj are independent and further that Yj is independent 
of all Xi : i ^ j given Xj . If TL is finite these are referred to as Hidden Markov 
models. The general case though focussing on X Euclidean is referred to as 
state space models. Essentially we observe only the Y's and want to infer 
statistical properties of the X's given the Vs. The fundamental problems of 
filtering, smoothing prediction are to give algorithms for computing exactly or 
approximately the conditional distribution of Xt given {Yi, ■ ■ ■ , Yt) (Filtering), 
the conditional distribution of Xt given Yi, . . . ,Yr, T > t (Smoothing) and 
the conditional distribution of Xt+i, . . . ,Xt given Y\,...,Yt (Prediction). If 
as is usually the case P is unknown and is assumed to belong to a smooth 
parametric family of probabilities {Pe : 8 £ R d } ,we face the further problem 
of efficiently estimating 9 using Y\, . . . ,Yt (computation of the likelihood, and 
maximum likelihood estimation, etc.). 

State space models have long played an important role in signal processing. 
The Gaussian case can be treated algorithmically using the famous Kalman 
filter [6]. Similarly since the 1970s there has been extensive application of 
Hidden Markov models in speech recognition with prediction being the most 
important goal. The basic theoretical work here, in the case X and y finite 
(small) providing both algorithms and asymptotic analysis for inference is 
that of Baum and colleagues [1]. During the last 30-40 years these general 
models have proved of great value in applications ranging from genomics to 
finance — see for example [7]. 
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Unless the X, Y are jointly Gaussian or X is finite and small the problem 
of calculating the distributions discussed and the likelihood exactly are nu- 
merically intractable and if y is not finite asymptotic analysis becomes much 
more difficult. Some new developments have been the construction of so-called 
"particle filters" (Monte Carlo type) methods for approximate calculation of 
these distributions (see Doucet et al. [4]) for instance and general asymptotic 
methods for analysis of statistical methods in HMM [2] and other authors. 

We will discuss these methods and results in the light of exponential mixing 
properties of the conditional (posterior) distribution of (X\ , X2 , ■ ■ ■) given 
(Yi,Y2, ■ ■ ■) already noted by Baum and Petrie [1] and recent work of the 
authors Bickel, Ritov and Ryden [3], Del Moral and Jacod in [4], Douc and 
Matias [5]. 
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